Papers with teaching models
PretrainRL: Alleviating Factuality Hallucination of Large Language Models at the Beginning (2026.findings-acl)
Copied to clipboard
Langming Liu, Kangtao Lv, Haibin Chen, Weidong Zhang, Yejing Wang, Shilei Liu, Xin Tong, Yujin Yuan, Yongwei Wang, Wenbo Su, Bo Zheng
| Challenge: | Large language models suffer from factual hallucinations where they generate verifiable falsehoods. |
| Approach: | They propose a framework that integrates reinforcement learning into the pretraining phase to consolidate factual knowledge. |
| Outcome: | The proposed framework significantly alleviates factual hallucinations and outperforms state-of-the-art methods. |
S2R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to incentivize LLMs’ deep thinking abilities require large-scale data or significant training efforts. |
| Approach: | They introduce an efficient framework that enhances LLM reasoning by teaching models to self-verify and self-correct during inference. |
| Outcome: | The proposed framework outperforms models trained on long-CoT distilled data with 3.1k initialization samples and achieves an accuracy improvement of 51.0% to 81.6%. |